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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
12/18/2008 has been entered. 



Claim Rejections - 35 USC § 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis 
for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States, 
(e) the invention was described in (1 ) an application for patent, published under section 1 22(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of 
this subsection of an application filed in the United States only if the international application designated the 
United States and was published under Article 21(2) of such treaty in the English language. 



Claims 1-21 and 23-28 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Madrane (6573907). 

Re claim 1 , Madrane discloses a data handling device comprising a display (column 2 
lines 1-2 for example) for displaying representations of the media objects (see abstract, root 
images for example), data storage means (see column 20 lines 24-26 for example) for allocating 
metadata tags (see column 13 line 66 to column 14 line 1, information designating these objects 
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as "extractable" for example) to the media objects, an input device (interface viewer unit for 
example) comprising means to allow (e.g., not prevent) a representation of a selected media 
object (e.g., area of interest) to be selectively moved by a user into a region of the display (e.g., 
the area of interest is moved until it takes up the whole display, when moving up close) 
representing a selected set of metadata tags (e.g., when moving up close, the display represents 
the area of interest, which includes metadata tags) (see figurers 17-18; col. 12, 1. 57 to col. 13, 1. 
15), and user activated means for causing the selected set of metadata tags to be added to those 
allocated to the selected media object in the data storage means (see column 13 line 66 to column 
14 line 3; column 30, 1. 5-17) (e.g., a designer may designate an area of interest of an image to 
be extractable, and to be bounded and associated with a URL). 

Re claim 2, Madrane discloses a data handling device, configured to allow a user to 
generate additional metadata tags (see column 15, lines 18-20, additional text for example) 
having new values, such that the media objects may be further categorized. 

Re claim 3, Madrane discloses a data handling device, configured to allow a user to 
obtain a view of media objects to which one or more of a predetermined plurality of metadata 
tags have been added (see figure 43 for example). 

Re claim 4, Madrane discloses a data handling device, configured to allow a user to 
obtain a view of media objects to which each of a predetermined plurality of metadata tags have 
been added (see figure 35 for example). 

Re claim 5, Madrane discloses a data handling device, wherein means are provided to 
provide user control of the maximum number of metadata tag sets to be displayed (define how 
many, see column 7 line27 for example). 
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Re claim 6, Madrane discloses a data handling device, in which representations of the 
media objects are capable of being moved between regions of the display area representing sets 
of metadata tags having pre-defined values (identify which are "hot objects", see column 7 lines 
30-31 for example). 

Re claim 7, Madrane discloses a data handling device, comprising means for removing a 
representation of a selected media object from one display area and adding it to a second area, 
thereby applying the metadata tag set associated with the second area to the selected media 
object in place of the set of metadata tags associated with the first area (see column 7 lines 30-33 
for example). 

Re claim 8, Madrane discloses a data handling device wherein a representation of a 
media object selected from a display area associated with a first metadata tag set applied to the 
media object may remain there whilst a copy of the selected media object is placed in a second 
area of the display area, thereby applying the metadata tag set associated with the second area to 
the media object in addition to the set associated with the first area (see column 20 lines 45-50 
for example). 

Re claim 9, Madrane discloses a data handling device, providing means for indicating the 
number of media objects associated with a given set of metadata tags (column 7 lines 25-31 for 
example). 

Re claim 10, Madrane discloses a data handling device, providing means for indicating 
the number of metadata tags associated with one or more media objects (define how 
many. . .what image information, see column 7 lines 25-37 for example). 
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Re claim 11, Madrane discloses a data handling device, providing means for identifying 
media objects to which no metadata tags have been applied by providing a display area 
representing an empty set (identify which objects in the scene are "hot objects", see column 7 
lines 30-34 for example). 

Re claim 12, Madrane discloses a data handling device, providing means for selecting a 
subset of the media objects for allocating a given set of metadata tags ("hot objects" and what 
image information will be displayed, see column 7 lines 30-34 for example). 

Re claim 13, Madrane discloses a data handling device, providing means for making the 
size of the display area allocated to each set of metadata tags proportional to the number of 
media objects portrayed therein (see column 5 lines 34-40 for example). 

Re claim 14, Madrane discloses a computer program or suite of computer programs for 
use with one or more computers to provide any of the apparatus as set out in claim 1 (see column 
2 line 10 for example). 

Re claim 15, Madrane discloses a method of organizing and storing media objects for 
subsequent retrieval, the media objects being represented in a display, wherein in which 
metadata tags are applied to the media objects by selecting an individual media object from the 
display, and causing a set of metadata tags to be added to the selected media object by selectively 
placing a representation of the selected media object in a region of the display selected to 
represent the set of metadata tags to be added (see column 7 lines 25-35 for example). 

Re claim 16, Madrane discloses a method, in which a user may generate additional 
metadata tags having new values, such that the media objects may be further categorized (see 
column 15 lines 17-20 for example). 
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Re claim 17, Madrane discloses a method, wherein a view is provided of media objects to 
which one or more of a predetermined plurality of metadata tags have been added (see column 
15 lines 17-20, see figure 43 for example). 

Re claim 18, Madrane discloses a method, wherein a view is provided of media objects to 
which each of a predetermined plurality of metadata tags have been added (see figure 35 for 
example). 

Re claim 19, Madrane discloses a method, wherein provision is made to control the 
maximum number of categories to be displayed (define how many, see column 7 line 27 for 
example). 

Re claim 20, Madrane discloses a method, in which representations of the media objects 
are moved between regions of the display area representing sets of metadata tags having pre- 
defined values (see column 7 lines 30-31 for example). 

Re claim 21, Madrane discloses a method, wherein a representation of a media object is 
selected from a first display area associated with a first metadata tag set, and a copy of the 
selected representation is placed in a second area of the display whilst the original representation 
remains in the first area, thereby applying the metadata tag set associated with the second area to 
the media object, in addition to the set associated with the first area (see column 20 lines 45-50 
for example). 

Re claim 23, Madrane discloses a method, wherein the number of media objects 
associated with a given set of metadata tags is indicated (see column 7 lines 25-3 1 for example). 

Re claim 24, Madrane discloses a method, wherein the number of metadata tags 
associated with one or more media objects is indicated (see column 7 lines 25-37 for example). 
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Re claim 25, Madrane discloses a method, wherein media objects to which no metadata 
tags have been applied are identified by providing a display area representing an empty set (see 
column 7 lines 25-37 for example). 

Re claim 26, Madrane discloses a method, wherein a subset of the media objects may be 
selected for allocation of a given set of metadata tags (see column 7 lines 25-35 for example). 

Re claim 27, Madrane discloses a method, wherein the size of the display area allocated 
to each set of metadata tags is proportional to the number of media objects portrayed therein (see 
column 5 lines 34-40 for example). 

Re claim 28, Madrane discloses a computer program or suite of computer programs for 
use with one or more computers to provide the method of claim 15 (see column 2 line 10 for 
example). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

A patent may not be obtained though the invention is not identically disclosed or described as set forth 
in section 102 of this title, if the differences between the subject matter sought to be patented and the 
prior art are such that the subject matter as a whole would have been obvious at the time the invention 
was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the 
claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of the various 
claims was commonly owned at the time any inventions covered therein were made absent any 
evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1 .56 to point out 
the inventor and invention dates of each claim that was not commonly owned at the time a later 
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invention was made in order for the examiner to consider the applicability of 35 U.S. C. 103(c) 
and potential 35 U.S. C. 102(e), (f) or (g) prior art under 35 U.S. C. 103(a). 

Claim 22 is rejected under 35 U.S.C. 103(a) as being unpatentable over Madrane 
Re claim 22, Madrane substantially discloses a method as set forth in claim 20 above. 
Madrane does not explicitly disclose a representation of a selected media object may be removed 
from a first display area associated with one metadata tag set when added to a second display 
area, thereby applying the set of metadata tags associated with the second display area to the 
selected media item in place of the set of metadata tags associated with the firs display area. 
Madrane teaches of applying the set of metadata tags associated with the second display area to 
the selected media item in place of the set of metadata tags associated with the firs display area 
when added to a second display area. Deleting functions are well known. It would have been an 
obvious matter of design choice to have a representation of a selected media object may be 
removed from a first display area associated with one metadata tag set when added to a second 
display area, since such a modification would have involved the mere application of a known 
technique to a piece of prior art ready for improvement. Where a claimed improvement on a 
device or apparatus is no more than "the simple substitution of one known element for another or 
the mere application of a known technique to a piece of prior art ready for improvement," the 
claim is unpatentable under 35 U.S.C. 103(a). Ex Parte Smith, 83 USPQ.2d 1509,1518-19 
(BPAI, 2007) (citing KSR v. Teleflex, 127 S.Ct. 1727, 1740, 82 USPQ2d 1385, 1396 (2007)). 
Accordingly Applicant claims a combination that only unites old elements with no change in the 
respective functions of those old elements, and the combination of those elements yields 
predictable results; absent evidence that the modifications necessary to effect the combination of 
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elements is uniquely challenging or difficult for one of ordinary skill in the art, the claim is 
unpatentable as obvious under 35 U.S.C. 103(a). Ex Parte Smith, 83 USPQ.2d at 1518-19 
(BPAI, 2007) (citing KSR, 127 S.Ct. at 1740, 82 USPQ2d atl396. 

Response to Arguments 

Applicant's arguments have been fully considered but are not persuasive. Examiner 
reiterates that references to specific columns, figures or lines should not be limiting in any way. 
The entire reference provides disclosure related to the claimed invention. Applicant argues that: 

1) The Examiner asserts that in Madranc the designer of the interface is the user. See 
Office Action at page 10. The Examiner's assertion is incorrect, however, since Madrane clearly 
defines the designer of the interface as being separate from a user. See Madrane at column 13, 
line 60 to column 14, line 15 (page 8, first paragraph). 

Examiner disagrees. 

Madrane at column 13, line 60 to column 14, line 15 teaches a designer designating 
objects as extractable, and then when a user expresses interest in one of the objects by clicking 
on it, removing extraneous portions of the displayed frame, leaving only a representation of two 
people and their motion. In other words, Madrane teaches a first user who uses Madrane's 
invention to design a program, and a second user who uses the program created through 
Madrane's invention. 
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2) Applicants' invention is concerned with the manipulation of data, not of images per-se. 
There is nothing in Madrane providing for media objects to be tagged differently according to 
the region of the display in which the user chooses to position them (using an input device) and 
adding the different tags to the media objects. Indeed, Madrane teaches the exact opposite in that 
it is important to Madrane's system that the same object, located in different positions in different 
frames, is identified as one and the same (page 9, penultimate paragraph). 

Examiner disagrees. 

Madrane (col. 12, 1. 57 to col. 13, 1. 15) teaches calculating the image data required to 
generate a display image using a ray tracing technique so that, for example, when a user 
designates a viewing position up close to an interactive video icon additional frames besides the 
basic video frames are generated, and causing parts of the root image distant from an area of 
interest to be omitted from the displayed close-up image. Thus, Madrane teaches that media 
objects are tagged differently according to the region of the display in which the user chooses to 
position them and adding the different tags to the media objects (e.g., if an object is within 
relative short distance of an area of interest, metadata will indicate that the object is to be 
displayed when a user designates a viewing position up close, otherwise the metadata will 
indicate that said object may be omitted from the display). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jordany Nunez whose telephone number is (571)272-2753. The 
examiner can normally be reached on Monday Through Thursday 9am-7 :30pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, William Bashore can be reached on (571)272-4088. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

JN 

2/24/2009 



/William L. Bashore/ 

Supervisory Patent Examiner, Art Unit 2175 



